Decomposition of Finitely Additive Markov Chains in Discrete Space

نویسندگان

چکیده

In this study, we consider general Markov chains (MC) defined by a transition probability (kernel) that is finitely additive. These were constructed S. Ramakrishnan within the concepts and symbolism of game theory. Here, study these MCs using operator approach. our work, state space (phase space) MC has any cardinality sigma-algebra discrete. The construction phase allows us to decompose kernel (and operators it generates) into sum two components: countably additive purely kernels. We show atomic. Some properties with their invariant measures are also studied. A class combined its subclasses introduced, proven. asymptotic regularities such revealed.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Multiple time scale decomposition of discrete time Markov chains

'Pae multiple time scale decomposition of discrete time, finite state Markov chains is addressed. In [1, 2], the behavior of a continuous time Markov chain is approximated using a fast time scale, e-independent, continuous time process, and a reduced order perturbed process. The procedure can then be iterated to obtain a complete multiple time scale decomposition. In the discrete time case pres...

متن کامل

Transport-entropy inequalities and curvature in discrete-space Markov chains

Let G = (Ω, E) be a graph and let d be the graph distance. Consider a discrete-time Markov chain {Zt} on Ω whose kernel p satisfies p(x, y) > 0 ⇒ {x, y} ∈ E for every x, y ∈ Ω. In words, transitions only occur between neighboring points of the graph. Suppose further that (Ω, p, d) has coarse Ricci curvature at least 1/α in the sense of Ollivier: For all x, y ∈ Ω, it holds that W1(Z1 | {Z0 = x},...

متن کامل

Discrete Quantum Markov Chains

A framework for finite-dimensional quantum Markov chains on Hilbert spaces is introduced. Quantum Markov chains generalize both classical Markov chains with possibly hidden states and existing models of quantum walks on finite graphs. Quantum Markov chains are based on Markov operations that may be applied to quantum systems and include quantum measurements, for example. It is proved that quant...

متن کامل

Additive Schwarz Iterations for Markov Chains

A convergence analysis is presented for additive Schwarz iterations when applied to consistent singular systems of equations of the form Ax = b. The theory applies to singular M -matrices with one-dimensional null space and is applicable in particular to systems representing ergodic Markov chains, and to certain discretizations of partial differential equations. Additive Schwarz can be seen as ...

متن کامل

Restricted additive Schwarz methods for Markov chains

The Restricted Additive Schwarz (RAS) method is adapted to the problem of computing the stationary probability distribution vector of large, sparse, irreducible stochastic matrices. Inexact and two-level variants are also considered, as well as acceleration by Krylov subspace methods. The convergence properties are analyzed and extensive numerical experiments aimed at assessing the effect of va...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Mathematics

سال: 2022

ISSN: ['2227-7390']

DOI: https://doi.org/10.3390/math10122083